Many‐field packet classification with decomposition and reinforcement learning
نویسندگان
چکیده
Scalable packet classification is a key requirement to support scalable network applications like firewalls, intrusion detection, and differentiated services. With ever increasing in the line-rate core networks, it becomes great challenge design solution using hand-tuned heuristics approaches. In this paper, we present learning-based engine by building an efficient data structure for different ruleset with many fields. Our method consists of decomposition fields into subsets separate decision trees on those deep reinforcement learning procedure. To decompose given ruleset, consider grouping metrics standard deviation individual introduce novel metric called diversity index (DI). We examine schemes construct each scheme compare results. The results show that SD 11.5% faster than DI metrics, 25% random 2 40% 1. Furthermore, our selection can be applied varying rulesets due its independence.
منابع مشابه
Forgetting Classification and Measurement for Decomposition-based Reinforcement Learning
Forgetting is a memory phenomenon that affects knowledge used to perform behaviors and tasks. In this work, two metrics are presented to aid the diagnosis of forgetting in decomposition-based reinforcement learning systems. With these metrics, developers now have the ability to classify types of forgetting, identify when important knowledge is lost, located wasted computation effort, and verifi...
متن کاملTask Decomposition in Reinforcement Learning
Decomposing a complex task into a set of simpler subtasks is a common technique used by problem solving agents. In reinforcement learning decomposition can be used by having separate modules learn to achieve individual subgoals independently and in parallel. Since each module can ignore parts of the state space that are not relevant to its task, learning time is drastically reduced. However, si...
متن کاملQ-Decomposition for Reinforcement Learning Agents
The paper explores a very simple agent design method called Q-decomposition, wherein a complex agent is built from simpler subagents. Each subagent has its own reward function and runs its own reinforcement learning process. It supplies to a central arbitrator the Q-values (according to its own reward function) for each possible action. The arbitrator selects an action maximizing the sum of Q-v...
متن کاملHierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
This paper presents a new approach to hierarchical reinforcement learning based on decomposing the target Markov decision process (MDP) into a hierarchy of smaller MDPs and decomposing the value function of the target MDP into an additive combination of the value functions of the smaller MDPs. The decomposition, known as the MAXQ decomposition, has both a procedural semantics—as a subroutine hi...
متن کاملTitle of Thesis: Improving Packet Classification: Learning from Traffic Improving Packet Classification: Learning from Traffic
Some rules in a packet classifier’s ruleset are more likely to be matched than others. Which of these rules are most likely to be matched cannot be known a priori, however. As a result, a classifier should be able to adapt itself to the traffic that it sees. This thesis explores the idea of using the traffic a packet classifier is seeing to tune that classifier’s search structure in order to im...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IET networks
سال: 2022
ISSN: ['2047-4954', '2047-4962']
DOI: https://doi.org/10.1049/ntw2.12038